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Abstract. Many AI tasks can be formalized as constraint satisfaction 
problems (CSPs), which involve finding values for variables subject to 
constraints. While solving a CSP is an NP-compiete task in general, 
tractable classes of CSPs have been identified based on the structure of 
the underlying constraint graphs. Much effort has been spent on exploit- 
ing structural properties of the constraint graph to improve the efficiency 
of finding a solution. These efforts contributed to development of a class 
of CSP solving algorithms called decomposition algorithms. The strength 
of CSP decomposition is that its worst-case complexity depends on the 
structural properties of the constraint graph and is usually better than 
the worst-case complexity of search methods. Its practical application is 
limited, however, since it cannot be applied if the CSP is not decompos- 
able. In this paper, we propose a graph based backtracking algorithm 
called w-CDBT, which shares merits and overcomes the weaknesses of 
both decomposition and search approaches. 


1 Introduction 

Many AI tasks can be formalized as constraint satisfaction problems (CSPs), 
which involve finding values for variables subject to constraints. While con- 
straint satisfaction in its general form is known to be NP-complete, many CSPs 
are tractable and can be solved efficiently. Much work has been done to iden- 
tify tractable classes of CSPs based on the structure of the underlying constraint 
graphs and many deep and insightful results have been obtained in this direction 
[12, 1, 15, 8, 6, 9, 28, 29, 3, 17, 18, 21, 10, 20, 24, 25]. A serious practical limitation 
of this research, however, has been its focus on backtrack-free conditions. Obvi- 
ously, a CSP which has backtrack-free solutions is tractable, but a tractable CSP 
does not necessarily have backtrack-free solutions. In practice, many researchers 
have tried to improve the efficiency of finding a solution by exploiting the struc- 
tural properties of the constraint graph. A class of structure-based CSP solving 
algorithms, called decomposition algorithms, has been developed [14, 16, 4, 7]. 
Decomposition algorithms attempt to find solutions by decomposing a CSP into 
several simply connected sub-CSPs based on the underlying constraint graph and 
then solving them separately. Once a CSP is decomposed into a set of sub-CSPs, 
all solutions for each sub-CSP are found. Then a new CSP is formed where the 
original variable set in each sub-CSP is taken as a singleton variable. Usually 


the technique aims at decomposing a CSP into sub-CSPs such that the number 
of variables in the largest sub-CSP is minimal and the newly formed CSP has a 
tree-structured constraint graph. In this way, the time and space complexity of 
finding all solutions for each sub-CSP is bounded, and the newly formed CSP 
has backtrack- free solutions. The complexity of a decomposition algorithm is 
exponential in the size of the largest sub-CSP. The class of CSPs that can be 
decomposed into sub-CSPs such that their sizes are bounded by a fixed number 
k is tractable and can be solved by decomposition in polynomial time. This is 
the strength of CSP decomposition. A fatal weakness of CSP decomposition, 
however, is that the decomposition is not applicable to solving a CSP that is not 
decomposable, that is, its decomposition is itself. A secondary drawback of CSP 
decomposition is that, even if the CSP is decomposable, finding all solutions for 
all the sub-CSPs is unnecessary and inefficient. 

In this paper, we propose a graph based backtracking algorithm, called u- 
CDBT, which shares the strength of CSP decomposition and overcomes its weak- 
nesses. As with CSP decomposition, o;-CDBT decomposes the underlying con- 
straint hypergraph into an acyclic graph. Unlike CSP decomposition, however, 
cj-CDBT only tries to find one solution for a chosen sub-CSP, which is not sep- 
arated from other sub-CSPs, and then tries to extend it to other sub-CSPs. 
The a>-CDBT algorithm uses a constraint representative graph called u;-graph 
[24, 22, 25]. The complexity of u;-CDBT is exponential in the degree of cyclicity 
of the o;-graph. Nevertheless, the significant contributions of this research on 
combining search with constraint structure are: 1) The class of CSPs with the 
property that the degree of cyclicity of the associated o;-graph is less than a fixed 
number k is tractable. As shown in [24, 22, 25], given a constraint hypergraph, 
the degree of cyclicity of an o;-graph is less than or equal that of the constraint 
hypergraph. Therefore, the class of CSPs that is u>-CDBT solvable in polynomial 
time includes the class of CSPs that is solvable in polynomial time by other de- 
composition algorithms such as hinge decomposition [16]. 2) For CSPs that do 
not have the above mentioned property, i^-CDBT still has a better worst-case 
complexity bound than other decomposition algorithms such as hinge decompo- 
sition [16], which in turn has a better worst-case complexity bound than search 
algorithms that do not exploit constraint structure. In both cases, w-CDBT also 
has advantage over decomposition algorithms in that it finds only one solution 
for each sub-CSP which saves space and time. 3) In cases where CSPs are not 
decomposable, decomposition algorithms are not applicable whereas u;-CDBT 
degenerates to CDBT [23] which is still a practical CSP solving algorithm. 

The paper is organized as follows. We first give definitions of constraint satis- 
faction problems and briefly overview constraint graphs and CSP decomposition. 
We then present the cj-CDBT algorithm, analyze its complexity, and compare 
it with decomposition algorithms. 



2 Preliminaries 

2.1 Constraint Satisfaction Problems 

A constraint satisfaction problem (CSP) is a structure (X,D, V,S). Here, X = 
{Xi, X 2 , . . X n } is a set of variables that may take on values from a set 
of domains D = {Pi, P 2 , D n }, and V = {Vi, V 2 , . . . , V m ) is a family of 
ordered subsets of X called constraint schemes. Each V{ = {X il} X, 2 , . . . ,Xi ri } 
is associated with a set of tuples Si C P^ x P* 2 x . . . x P iri called constraint 
instance , and 5 = {5 i, 52, . . . , 5 m } is a family of such constraint instances. 
Together, an ordered pair (Vi, Si) is a constraint or relation which permits the 
variables in V x to take only value combinations in Si. 

Let (X, P, V, 5) be a CSP, V* = {X fc] , X* 2 , ..,X fc| }a subset of X. A 
tuple (xku Xk 2 , . in P^ x x ... x P^ is called an instantiation 
of variables in Vk. An instantiation is said to be consistent if it satisfies all 
constraints restricted in Vk* A consistent instantiation of all variables in X is 
a solution to the CSP (X, P, V”, 5). The task of solving a CSP is to find one or 
more solutions. 

A constraint {Vh, Sh) in a CSP (X, D,V, S) is minimal if every tuple in Sh 
can be extended to a solution. A CSP (X,P, V, 5) is minimal if every constraint 
is minimal. 

A binary CSP is a CSP with unary and binary constraints only, that is, every 
constraint scheme contains at most two variables. A CSP with constraints not 
limited to unary and binary is referred to as a general CSP . 

We will also use some relational operators, specifically, join and projection. 
Let Ci = (Vi, Si) and Cj = (Vj,Sj) be two constraints. The join of Ci and Cj is 
a constraint denoted by Ci M Cj. The projection of Ci = (Vi, Si) on Vh C Vi is a 
constraint denoted by IIv h (Ci). The projection of U on Vh, denoted by £*[Vy, is 
a tuple consisting of only the components of U that correspond to variables in 

V h . 


2.2 Graph Theory Background 

In this section, we review some graph theoretic terms we will need later and we 
define constraint representative graphs, namely, the line graph, the join graph, 
and the n;-graph. 

A graph G is a structure (V, E), where V is a set of nodes and E is a set of 
edges, with each edge joining one node to another. 

A subgraph of G induced by V' C V is a graph (V f , E f ) where E' C E contains 
all edges that have both their endpoints in V*. A partial graph of G induced by 
E f C E is a graph ( V \ E f ). 

A path or a chain is a sequence of edges E±, E 2 , . . . , E q such that each E x 
shares one of its endpoints with E x - 1 and the other with Ei+±. A cycle is a chain 
such that no edge appears twice in the sequence, and the two endpoints of the 
chain are the same node. A graph is connected if it contains a chain for each pair 


of nodes. A connected component of a graph is a connected subgraph. A graph 
is acyclic if it contains no cycle. A connected acyclic graph is a tree . 

Let G = (V,E) be a connected graph. A node V is called a cut node (or 
articulation node) if the subgraph induced by V — {Vi} is not connected. A block 
(or nonseparable component) of a graph is a connected component that contains 
no cut nodes of its own. An 0(|JJ|) algorithm exits for finding all the blocks and 
cut nodes [11]. 

Let G = (V, E) be a connected graph. The degree of cyclicity of G is defined 
as the number of nodes in its largest block. A graph is k-cyclic if its degree of 
cyclicity is at most k. 

A hypergraph is a graph with hyper edges ; that is, an edge in a hypergraph 
may contain more than two nodes. The graph notations reviewed above can 
be extended to hypergraph, such as sub-hypergraph , partial hypergraph , path , 
connected component , block , and so on. These definitions can be found in [2]. 

A graph G = ( V , E) can be decomposed into a tree of blocks Tb = (Vb ,Eb)' 
1) choose a block Q Vb , which contains at least one non-cut node, as the 
root node of Tb and mark it; 2) for each unmarked block Xb , that has a node 
in common with block Xb^ connect Xb j as a child node of Xsi with an edge 
(Xb^Xbj) and mark it; 3) take each child node of Xb. as the root node of a 
subtree, repeat 2) and 3); 4) stop when every block is marked. 

For example, give a graph G = (V, E) as shown in Figure 1 (A), we can have 
a block tree as in Figure 1 (B), where B\ = {Vi, V 2} V3, V 4 }, B2 = {V2, Vs, V$}, 
Bz = {V B ;V 7t Vsh B 4 = {Vq, V9, Vio}, B 5 = {V 3} V u ,V l2 }, B 6 = {F 3 , 

B'j ~ {V4, V15, Fie}. The cut nodes in this graph are V 2) V3, V 4 , V5, and Vq 

A block tree determines an order on the block set. For example, block set 
B = {Bi, B 2} Bz, B 4 , Bs, Bq, B 7 } is in the depth-first order. For each block Bk 
(2 < k) there is a cut node V ak of the graph that separates this block from its 
parent block, and there is a node V ai in B\ which is not in any other blocks. 
These nodes are called separating nodes. For example, the separating nodes of 
the graph in Figure 1 (A) are Vi, V 2 , F 3 , V 4 , V5, and Vq 



(A) A connected graph 


(B) A block tree 


Fig. 1 . A graph and its block tree 



A binary CSP is associated with a simple constraint graph, which has been 
well studied and widely used for analyzing and solving binary CSPs [13, 7, 5], 
A general CSP is associated with a constraint hypergraph, but the topological 
properties of the hypergraph have not been well studied in the area of constraint 
satisfaction problems. Instead, constraint representative graphs such as the line 
graph , the join graph , and the uj-graph have been studied and used to analyzing 
and solving general CSPs [20, 1.9, 16, 24, 25, 26, 27]. 

Given a CSP (X,D,V,S) and its hypergraph H = (X,V), the line-graph 
3 is a simple graph 1(H) = (V,L) in which nodes in V are hyperedges of the 
hypergraph and with two nodes joined with an edge in L if these two nodes 
share common variables. A join graph j(H) = (V,J) is a partial linegraph in 
which some redundant edges are removed. An edge in a linegraph is redundant 
if the variables shared by its two end nodes are also shared by every nodes along 
an alternative path between the two end nodes. An t^-graph w(H) = (W, F) 
is another constraint representative graph. The node set W of an cj-graph is a 
subset of nodes V in the line graph such that any node inV — Wis covered by 
two nodes in W; that is, if Vk € V — W , then there exist Vi an Vj in V, such 
that Vk C Vi U Vj. There is an edge joining two nodes if either the two nodes 
share common variables or they cover a node that is not in W. 

For example, given a hypergraph H = (. X , V) as in Figure 2 (A) with node set 
X = {X 1 ,X 2 ,X 3 ,X4,X 5 ,X 6 ,X 7 } and edge set V = where 

Vi - {X 1 ,X 2 }, V 2 - {X lj X 4j X 7 } } V 3 = {V 2 ,V 3 }, V 4 = {X 2y X 4 ,X 7 } : V5 = 
{X 3 ,X 5 ,X 7 }, Vq = {X 3 ,X 6 }. Its line graph 1(H) = (V,L) is in Figure 2 (B). 
There is an edge, for example, between Vi and V 2 because these two nodes share a 
common variable X\. Edge (V5, Vq) is redundant because the variable X 3 shared 
by Vs and Vq is also shared by every nodes on an alternative path between V5 and 
V 6 , that is, path (V 5 , V 3 , Vq). A join graph resulting from removing redundant 
edges is in Figure 2 (C), and an w-graph is in (D) in which there is only 4 nodes, 
since node Vi is covered by V 2 and V4, and node V3 by V5 and Vq. 

Since constraint representative graphs are simple graphs, all of those graph 
concepts mentioned previously are applicable. For example, an u;- graph (or a 
join graph) is k- cyclic if the number of nodes in its largest block is at most k . 
An u;-graph can be decomposed into a block tree. 

Notice that the line graph or a join graph is also an u>graph, but in general, an 
c^-graph is simpler than the line or join graph in terms of the number of nodes, the 
degree of cyclicity and the width. In particular, [22] gives an 0(\V\ 3 ) algorithm 
for constructing an a;-graph for a hypergraph with the following property: 

Proposition 1. Given a hypergraph H = (X, V) } there exists an u -graph whose 
degree of cyclicity is less than or equal the degree of cyclicity of any join graph . 

Note that the degree of cyclicity of a hypergraph is defined in [16] as the 
degree of cyclicity of its minimal join graph. The above proposition indicates 
that a hypergraph has an cj-graph whose degree of cyclicity is less than or equal 
that of the hypergraph. 


3 A line graph is also called an inter graph in [19] and a dual-graph in [7]. 



(C) A join graph (D) An ci> graph 

Fig. 2. A hypergraph and its representative graphs 


2.3 CSP Decomposition 

Decomposition algorithms attempt to find solutions more efficiently by decom- 
posing a CSP into a set of sub-CSPs such that these sub-CSPs form a tree 
and the size of the largest sub-CSP is minimized. In general, a decomposition 
algorithm works as follows: 

1. decompose the constraint hypergraph into a tree; 

2. find all solutions to each sub-CSP associated with each node in the tree; 

3. form a new CSP where the original variable set in each tree node is taken as 

a singleton variable; 

4. find one solution to the new CSP. 

Many decomposition algorithms have been developed [14, 16, 7, 4] and they 
usually differ in the first step. A comparison of most notable decomposition algo- 
rithms can be found in [14]. As pointed out in [14], each decomposition method 
defines a parameter as a measure of cyclicity of the underlying constraint hyper- 
graph such that, for a fixed number k, all CSPs with the parameter bounded by 
k are solvable in polynomial time. 

w-graph fits well into this decomposition scheme in that we first construct an 
w-graph from a given constraint hypergraph and then decompose the u;-graph 
into a tree. It is obvious that many graph decomposition methods can be used to 
decompose an cu-graph. For simplicity, however, we choose the block tree method 
to decompose cu-graphs in this paper. 

The problem with the decomposition methods is that they cannot be ap- 
plied if a given CSP does not possess some required properties (for example, 



non-decomposible). Moreover, even if the underlying constraint graph is decom- 
posable, finding all solutions for every sub-CSP is inefficient and unnecessary. In 
the following, we propose a graph based backtracking algorithm called cj-CDBT 
that overcomes these weaknesses. 

3 u;- Graph Based Backtracking 

Let {X,D,V,S) be a CSP and C = {C { = {V u Si)\Vi € V,Si € S} a set of 
constraints. Let t o(H) = (W, F) be an a;-graph and B = {Si, i? 2 , • , £*} a set of 

blocks of oj(H) which is ordered in the depth-first manner according to the block 
tree, and each block Bk = {V kl , V* 2 , . . . , Vk l3kl } a set of nodes in which the first 
one is the separating node. Let cks a (Vi , Vj) denote the set of constraints on V —W 
covered by V { and Vj in W, that is, cks a (V u Vj) = {V k € F - W|V* C K* U k$}. 
The idea of the u>-CDBT algorithm is to search for a consistent assignment to 
variables involved in a block and then extend it to the child blocks. If at a block 
where no consistent assignment can be found, cj-CDBT backtracks to the parent 
block, reinstantiates variables in that block, and starts from there. Within a 
block, u>-CDBT uses a CDBT-like strategy [23] to find a consistent assignment 
to the variable subset in the block, which may involve backtracking within the 
block. The algorithm stops when a solution is found or when it proves that no 
solution exists. 

3.1 Algorithm 

The u>-CDBT performs backtrack at two nested levels which we call outer- BT 
and inner-BT. The inner-BT finds a consistent instantiation of variables in- 
volved in a block B k = {V kl ,Vk 2 , *•*, outer-BT calls inner-BT to 

find consistent instantiations for all blocks in the depth-first order. If a con- 
sistent instantiation of variables in the current block is found then outer-BT 
calls inner-BT again to find consistent instantiations of variables in its child 
blocks; otherwise, the outer-BT moves backward to the parent block and calls 
the inner-BT to find another consistent instantiation of variables in that block. 

The function DFS corresponding to the outer-BT, the inner-BT, which is 
based on CDBT [23], consisting of two recursive functions forward and goback , 
and an auxiliary function test are given below. In these functions, some notations 
are explained as follows: tupB k is a consistent instantiation of variables in B k \ 
solr k is a consistent instantiation of variables in the subtree rooted at B k \ childs k 
is a set of child blocks of B k \ changeds k is a flag indicating if the instantiation 
of variables in the separating node of B k has changed; idxs k is the index of 
the separating node of B k in the parent block; ts k is a current instantiation of 
variables in the separating node of B k , initialized as a nil-tuple. 

c u-DFS(B k ,Vi,tupi) 

1. begin 

2 . tup B k u-forward{B k , Vj , tupi ) ; 



3. if tupB k = 0 then return 0; 

4. for each Bj G child Bh do 

5. if changed Bj then 

6 . solxj u-DFS(Bj,Vj 1 ,tB j )\ 

7. if solTj = unsatisfiable then return unsatisfiable; 

8. if solTj = 0 then 

9. delete t Bj from Sji and Sfr ; 

10. if Sj 1 = 0 then return unsatisfiable ; 

11. V' *- ; tup' <- tup Bt [V']; 

12. return (cj-DFS(Bk,V' , tup')); 

13. changedBj <— false; 

14. end for 

15. return tupB k M (H Bj&child B k soIt } ); 

16. end 

forward(Bk , Vj , tupi ) 

1. begin 

2. if Vi — U Bk then return tupj; 

3. cks(V I+ 1 ) <- U*_ 1 cfcs 0 (14,- , Vfc. +1 ); 

4. Sj*. +J <— {tup\tup 6 5jfe j+ , , tup[Vi D Vfc j+1 ] = tup/[V} n Vfc i+1 ]}; 

5. while Sk i+1 ^ 0 do 

6. tup <— one tuple taken from S k i+ 1 ; 

7. tup/+i <— tupi M tup; 

8. if test(tupi+i,cks(Vi+i)) then 

9. for each Bj € childB k 

10. if V ki+1 G Bj and tup ^ t B . then t Bj tup ; changed Bj <- true 

11. return forward(B k , Vj+i, tupj+i); 

12. end while 

13. return goback{Bk,Vi,tupi)\ 

14. end 

#o&acA;(i?fc, V/, tupi) 

1. begin 

2. if V} = Vjkj then return 0; 

3. while 5* ^ 0 do 

4. tup <— one tuple taken from 5*“ ; 

5. tup/ <— tupj-x M tup; 

6. if test(tupi,cks(Vi)) then 

7. for each Bj G child Bk 

8. if V fci+1 € Bj and tup ^ i Bj . then t Bj «- tup; changed Bj <- true 

9. return forward{Bk, Vi, tupi); 



10. end while 

11. return goback(Bk,Vi-i,tupj- 1 ); 

12. end 

test(tupi,cks)) 

1. begin 

2. for each Ch — ( 14 , S&) in cks do 

3. if tupj\Yh] 0 Sh then return false; 

4. return true; 

5. end 

For a current block Bk — {Vki>Vk 2 , . . . and a partial instantiation 
tupj of variables in V7 = Uj =1 Vi^ , DF5 tries to extend tup/ to a consistent in- 
stantiation of variables involved in the subtree rooted at Firstly, it tries 
to extend tupj to a consistent instantiation tup#* of variables in Vg fc . This can 
be done by function forward . If forward succeeds, that is, if a consistent instan- 
tiation tups k is found, then DFS moves forward to those of its child blocks that 
have not been instantiated at all or their instantiations have been changed due 
to backtracking to the parent block. DFS calls itself recursively for each of the 
subtrees, and then returns the joined tuple tups k N (^B j echUd Bk s °It If for- 
ward fails, that is, if it does not find a consistent instantiation tups k of variables 
in Vs k such that tups fc ff^J = tup k x , then DFS reports that the tuple tupk x has 
no consistent extension to variables in Vs k . Before the algorithm backtracks to 
the parent block, the tuple tupk x is deleted from Sk x > since it will not be in any 
solution which will be explained in Section 3.3 and 5*^ is checked if it is empty. 
If it is empty then there is no solution to the problem, so DFS stops and reports 
unsatisfiable . If Sk x is not empty then DFS moves up to the parent block and 
starts from there. 

Within block Bk , suppose that we have already found a consistent instantia- 
tion tup i of variables in Vk x , V* 2 , . . M Vj^ (their union is denoted by 1^), function 
forward extends this instantiation by appending to it an instantiation of vari- 
ables in Vk iJrl which is a node in the u>-graph. forward chooses a tuple tup from 
as an instantiation of variables in Vfc i+1 and joins tup and tupj to form 
a new tuple tupi + 1 , which is tested to see if it is consistent. Notice that the 
subset S£. +l contains those tuples in S* i+1 that axe compatible with tupj . If 
tupi+i is consistent, then forward is called recursively to extend tupi+ 1 ; oth- 
erwise, another tuple from 5£. +i is tried. If no tuples are left in 5£. +i , goback 
is called to re-instantiate variables in variable set T4< • Function goback tries to. 
re-instantiate variables in and to form another consistent instantiation of 
variables in Vj = . It first chooses another tuple from S£, and forms a 

new tuple tupi which is tested to see if it is consistent. If tupj is consistent, then 
forward is called to extend tupj; otherwise, another tuple from is tried. If 
is empty, then goback is called recursively to re-instantiate variables in variable 
set Vki_ x . Note that goback does not re-instantiate variables in the separating 
node Vfcj. The tuple ts k for variables in was chosen when the parent block 


was dealt with. If ts k cannot be extended to variables in Bk , goback returns 0 
and passes the control to DFS which deletes ts k from S**. Backtracking across 
blocks occurs. 

Function test(tupK, cks) returns true if tuple tupK satisfies all the constraints 
in cks , and false otherwise. 

To find a solution to a given CSP IP = (X, £>, V, S), we need a main program 
such as the one given below to call DFS repeatedly until a solution is found or 
unsatisfiability is verified. 

uj-CDBT(lP , soZ) 

1. begin 

2. for each tup € do 

3. soZ <- , tup ) ; 

4. if soZ = unsatisfiable then return unsatisfiable ; 

5. if soZ ^ 0 then return soZ; 

6 . end for 

7. return unsatisfiable ; 

8 . end 

Algorithm DFS instantiates the variables in block Bj only if the values as- 
signed to the variables in the separating node of Bj have been changed; that is, 
only if changedBj is true (line 5 in the algorithm). At the first time of visiting 
Bj, changedBj is true since the variables in the separating nodes have been in- 
stantiated when the algorithm visits Bk, the parent block of Bj. However, when 
the algorithm goes back to re-instantiates the variables in Bk, the variables in 
the separating node may not be affected, in which case the assignment to the 
variables in Bj will be retained. Needless to say, this saves time of repeatedly 
finding values for the variables in the subtree rooted at Bj. However, an imme- 
diate question to ask is whether this causes the algorithm to miss any solutions. 

The answer is no because even if the algorithm does re-instantiate variables in 
Bj, the instantiation will be the same if the values assigned to the variables in 
the separating node of Bj have not been changed. 

3.2 Example 

We consider a CSP IP — (X, D, V, S) which has an u-g raph in Figure 1 (A) and 
we use this example to illustrate how the o;-graph based backtracking works. 

We are given an ordered block set B = {B\, B 2 , B 3) B±, B$, Be, By}, where 
each block is an ordered set of constraint schemes, that is: B\ = {Vi, V 2 , V3, V4}, 

b 2 = {V 2 l v 5 ,v 6 }, b 3 = {V 5 ,V 7 ,V 8 }, b 4 = {v 6 ,v g ,v 10 }, b 5 = {V 3 ,V IU V 12 }, 

Bq = {V 3 , V13, Vi 4 }, B 7 = {V4, Vis, Vie}. Let Vb* be the subset of variables 
involved in Bj. 

We start from u)-CDBT{P , sol), choose a tuple ts x € S\ and call DFS{B\, V\,tB x )* 
DFS first calls forward(Bi, Vl^Bx) to extend ts x to variables in Vb x * If it fails, 
then it will choose another tuple from S\ and start again. Suppose that it suc- 
ceeds and it returns a tuple tups x as a consistent instantiation of variables in 



V Bl , then DFS will be called recursively for each child block £ 2 , £5, Bq and B 7 . 
Recall that t Bi is the instantiation of variables in the separating node. For the 
first child block £2, £££(£2 , V2, £b 2 ) is called to extend £b 2 to variables involved 
in the subtree rooted at £2, which include the variables in V5, Vfc, V7, Vs, V9 and 
Vio- At first, forward(B2,V2,t B2 ) is called to extend £b 2 to variables in Vs and 
Vq. Suppose that it succeeds and it returns a tuple tup B2 as a consistent in- 
stantiation of variables in Vg 2 , then DFS will be called for the child blocks of 
£ 2 . Again, suppose that they all succeeds, that is, tuples solr 3 and solr 4 are re- 
turned. So, £££(£ 2 , V2,tupv 2 ) returns a tuple solr 2 = sol B2 M soIt 2 N soIt 4 as 
a consistent instantiation of variables involved in the subtree rooted at £ 2 - For 
the second child block £5, £££(£5, is called to extend t B 5 to variables 
involved in the subtree rooted at £5. It calls forward(Bs , V3 ,ts 5 ) to extend t Bs 
to variables in Vb 5 . If it succeeds, then DFS(Bs , V3 , t Bs ) will return a tuple soIt 5 * 
However, suppose that forward(Bs,Vs,t B5 ) fails, which means that t B5 cannot be 
extended to a consistent instantiation of variables in £5 , then £££(£5 , V3 ,t Bs ) 
returns soIt s which is a nil-tuple. Since solr 5 is empty, tuple t Bs is deleted 
from £3, and £3 is checked to determine if it is empty now. If it is, then there 
is no solution to the problem, DFS(Bi,Vi,t Bl ) will return unsatisfiable and 
CDBT{IP,sol) will return unsatisfiable. We suppose that £3 is not empty. Then 
DFS(Bi,V f ,tup f ) is called, where V* = V\ U V" 2 and tup' = tupv 1 M tupv 2 . This 
time, forward(Bi , V\ tup') is called to extend tup 1 to a consistent instantiation 
of variables in V Bl . If it finds one without re-instantiating variables in V2 and 
Vi, then the instantiation of variables involved in the subtree rooted at £2 is 
retained, and DFS is called for child nodes £5, £6, £7. If variables in V2 are re- 
instantiated, then the variables involved in the subtree rooted at £ 2 may have 
to be re-instantiated. However, whether or not variables in V Bz and V Bs need 
to be re-instantiated depends on whether or not V5 and Vq are re-instantiated. 
If forward(Bi , V r , tup f ) goes back to Vi, then DFS{B^V\tup r ) returns empty 
tuple, we will choose another tuple from Si and start from there. 


3.3 Analysis 

For analysis, we define minimal constraint and give a few technical lemmas, 
which have been proven in [22]. 

Let IP = (X, £, V, £) be a CSP and C = {C* - (V u Si)\Vi G^S^FJa set 
of constraints. Let H = (X, V) be the associated hypergraph, u(H) = (W, F) an 
a>-graph, £ == {£1, £ 2 , . . . , £j} a set of blocks ordered in the depth-first manner, 
and A = { V ai , V a2 , . . . , V ai } a set of separating nodes. Let V B . denote the subset 
of variables involved in block £*, 

Definition 2. Let (X, £, V, £) be a CSP, let V 9 be a subset of V and C" a subset 
of C restricted on V* . A sub-CSP induced by V 1 is a CSP (X', V 7 , S') where 

X' = |J V f , D f is a subset of the domains of variables in X', and S' is a set 
of constraint instances corresponding to V' . A constraint Ci G C' is said to be 
minimal relative to (X',D\ V', S') if every tuple in Si can be extended to a 
consistent instantiation of variables in X'. A constraint C* G C is said to be 


minimal if it is minimal relative to (X, D, V, S). A CSP is said to be minimal if 
every constraint is minimal. 

Let Ca — {(V^, S ai )\V ai £ A} be a subset of constraints on A. 

Lemma 3. If every constraint in Ca is minimal, then every consistent instan- 
tiation of variables involved in each block can be extended to a solution. 

This lemma suggests that if every constraint on those articulation nodes is 
minimal, then the relation represented by the sub-CSP corresponding to each 
block is minimal. The following lemma indicates that minimizing the constraints 
on articulation nodes can be done by minimizing them relative to each block. 

Lemma 4. If every constraint (V^,^.) in Ca is minimal relative to the sub- 
CSP induced by the block to which V ai belongs, then they are also minimal 

Lemma 5. Let B{ be a block and V a . the separating node. If a tuple in S ai has no 
consistent extension to variables in Vs i} then it cannot be extended to a solution. 

Based on this lemma, if a tuple in a constraint corresponding to an articu- 
lation node has no consistent extension to the variables involved in the block to 
which the articulation node belongs, it can be safely deleted. If every tuple in 
such a constraint is so, then there is no solution to the problem. 

Lemma 6. Let Bi be the parent block of Bj, and V aj the separating node in 
By Let tupBi and tups j be consistent instantiations of variable in Vj s i and 
Vbj respectively. If tupB { [V aj ] = tup Bj [V aj ] , then tups < ^ tups j is a consistent 
instantiation of variables V#. U Vs j . 

This lemma suggests that if we have a consistent instantiation tupBi vari- 
ables in a parent block Bi, extending tupBi to the variables in the child block 
Bj can be done by extending tupBi [V aj ] to the variables in Bj, so the consistent 
checking is restricted within the child block. 

Theorem 7. The lj-CDBT is correct. 

Proof. We prove that cj-CDBT is sound, complete, and it terminates. The 
CDBT algorithm has been proven to be correct in [23], the inner-BT consisting 
of forward and goback is correct with respect to each block. 

Based on Lemma 6, when a consistent instantiation of variables in the parent 
blocks is extended to a child block, the new instantiation to variables including 
variables in the child block is consistent. In particular, when a consistent instan- 
tiation is successfully extended to variables in the last block, we have a whole 
assignment which is a solution. This proves the soundness. 

The completeness follows from Lemma 5 and the fact that the inner-BT is 
complete. 

The search space of w-CDBT can be seen as a |W|-level tree, in which each 
level corresponds to a Vi € W, and w~CDBT visits every node in the search 



space at most once, it terminates. □ 


Suppose that the a;-graph is ^-cyclic and has l blocks. Let |s| be the size of 
the maximal constraint relations. 

Lemma 8. If every constraint in Ca is minimal , then any backtracking per- 
formed in uj-CDBT is restricted within each block f and the complexity of using 
cj-CDBT to solve a CSP with minimum constraints in Ca is 0(Z|s|*). 

Proof. Suppose that the algorithm has found a consistent instantiation of vari- 
ables in Vsi and it moves forward to a child block Bj. Finding a consistent 
instantiation of variables in Vs j may require backtracking but it will not back- 
track to the parent block B*, since, according to Lemma 3, the existing consistent 
instantiation of variables in can be extended to a solution. 

The time complexity of finding a consistent instantiation of variables involved 
in a block is 0(|s|*), and there are l blocks, so the time complexity of uj-CDBT 
is 0(l\s\ k ). □ 

Theorem 9. The time complexity ofw - CDBT is 0(l\s\ k ). 

Proof. Based on the Lemma 4, minimizing constraints in Ca can be done by 
minimizing them relative to each block. The complexity of minimizing a con- 
straint relative to a block is 0(|s| fc ), so the complexity of minimizing constraints 
in Ca is 0(Z|s| fc ). In the worst case (that is equivalent to using uj-CDBT to find 
all solutions), every constraint in Ca will be minimized, which takes 0(Z|s| fc ) 
time, and then finding solutions with minimized constraint in Ca takes another 
0(Z|s| fc ) time. Together, the time complexity of uj-CDBT is 0(Z|s| fc ). □ 

Since the complexity of solving the CSP by using u;-CDBT is exponential in 
k , a class of CSP where k is less than a fixed number is u - CDBT solvable in 
polynomial time. Following directly from Proposition 1, this class of tractable 
CSPs includes the class of CSPs solvable by the hinge decomposition [16]. 

4 Comparison with Decomposition and Other Search 
Methods 

A general decomposition scheme is given in Section 2.3 and an u;-graph based 
decomposition algorithm can be easily constructed. To compare u;-CDBT with 
decomposition algorithms including cu-graph based decomposition, we argue that 
u;-CDBT shares the virtue of tree search algorithms in that it finds only one 
consistent assignment to variables in each block which corresponding to a sub- 
CSP in the decomposition scheme. Finding one solution is more cost-effective 
than finding all solutions. 

Furthermore, the u;-CDBT algorithm has an additional two advantages over 
other search methods: 1) when a tuple tsi cannot be extended to a consistent in- 
stantiation of variables in Va* , It is deleted from the constraint on the separating 


node of I? 2 ; then all the sub-regions of search space rooted at nodes containing 
tBi will be ruled out to avoid further exploration; 2) when the algorithm back- 
tracks from a child block to the parent, the instantiation of the variables in the 
sibling blocks preceding this block may be retained, so that this sub-region of 
the search space does not need to be searched repetitively. 

Another advantage of tu-CDBT is its ability to overcome the failure of de- 
composition methods when a given CSP is not decomposable. In this case, the 
decomposition method degenerates into whatever method is used to find all solu- 
tions which is expensive. u;-CDBT, on the other hand, degenerates to the original 
CDBT algorithm which is still a practical CSP solving algorithm. 

5 Conclusion 

Constraint satisfaction in its general form is known to be NP-complete, yet many 
CSPs are tractable and can be solved efficiently. Every CSP has an associated 
constraint graph. The key idea is that the efficiency of finding a solution can be 
improved by exploiting structural properties of the constraint graph. The contri- 
butions of this paper are both theoretical and practical. First, we have identified 
a new tractable class of CSPs that contains previously identified tractable classes. 
This extends the known set of CSPs that are solvable in polynomial time. Sec- 
ond, we have provided an algorithm that solves CSPs in this class in polynomial 
time, whereas other known algorithms cannot guarantee polynomial time solu- 
tions for this class. Third, even outside of this class, the provided algorithm has 
a better worst case complexity. This extends the limits of what is solvable in 
practice. Future empirical study is required to evaulate the actual improvement 
of the u;-CDBT algorithm against other decompostion and search algorithms. 
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